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Abstract 

The sensor network localization, SNL , problem in embedding dimension r, consists of 
locating the positions of wireless sensors, given only the distances between sensors that are 
within radio range and the positions of a subset of the sensors (called anchors). Current solu- 
tion techniques relax this problem to a weighted, nearest, (positive) semidefinite programming, 
SDP, completion problem, by using the linear mapping between Euclidean distance matrices, 
EDM, and semidefinite matrices. The resulting SDP is solved using primal-dual interior point 
solvers, yielding an expensive and inexact solution. 

This relaxation is highly degenerate in the sense that the feasible set is restricted to a 
low dimensional face of the SDP cone, implying that the Slater constraint qualification fails. 
Cliques in the graph of the SNL problem give rise to this degeneracy in the SDP relaxation. 
In this paper, we take advantage of the absence of the Slater constraint qualification and derive 
a technique for the SNL problem, with exact data, that explicitly solves the corresponding 
rank restricted SDP problem. No SD P solvers are used. For randomly generated instances, 
we are able to efficiently solve many huge instances of this NP-hard problem to high accuracy, 
by finding a representation of the minimal face of the SDP cone that contains the SDP matrix 
representation of the EDM . The main work of our algorithm consists in repeatedly finding the 
intersection of subspaces that represent the faces of the SDP cone that correspond to cliques 
of the SNL problem. 



* Research supported by Natural Sciences Engineering Research Council Canada and a grant from AFOSR. 
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1 Introduction 



The sensor network localization problem, SNL, consists in locating the positions of n wireless 
sensors, pi £ W, i = l,...,n, given only the (squared) Euclidean distances Dij = \\pi — Pj^% 
between sensors that are within a given radio range, R > 0, and given the positions of a subset of 
the sensors, pi, % = n — m + 1, . . . , n (called anchors); r is the embedding dimension of the problem. 
Currently, many solution techniques for this problem use a relaxation to a nearest, weighted, 
semidefinite approximation problem 

min II Wo (K{Y) - D)\\ , (1.1) 

where Y y denotes positive semidefiniteness, Y £ Q denotes additional linear constraints, JC 
is a specific linear mapping, and o denotes the Hadamard (elementwise) product. This approach 
requires semidefinite programming, SDP, primal-dual interior point (p-d i-p) techniques; see, for 
example, [2j [31 (5[ [TOJ [121 EH [26]. This yields an expensive and inexact solution. 

The SNL problem is a special case of the Euclidean Distance Matrix, EDM, completion prob- 
lem, EDMC. If D is a partial EDM, then the completion problem consists in finding the missing 
elements (squared distances) of D. It is shown in [16], that there are advantages for handling the 
SNL problem as an EDMC, and ignoring the distinction between the anchors and the other sen- 
sors until after the EDMC is solved. In this paper we use this framework and derive an algorithm 
that locates the sensors by exploiting the structure and implicit degeneracy in the SNL problem. 
In particular, we solve the SDP problems explicitly (exactly) without using any p-d i-p techniques. 
We do so by repeatedly viewing SNL in three equivalent forms: as a graph realization problem, 
as a EDMC , and as a rank restricted SDP . 

A common approach to solving the EDMC problem is to relax the rank constraint and solve a 
weighted, nearest, positive semidefinite completion problem (like problem (jl.ip ) using semidefinite 
programming, SDP . The resulting SDP is, implicitly, highly degenerate in the sense that the 
feasible semidefinite matrices have low rank. In particular, cliques in the graph of the SNL problem 
reduce the ranks of these feasible semidefinite matrices. This means that the Slater constraint 
qualification (strict feasibility) implicitly fails for the SDP . Our algorithm is based on exploiting 
this degeneracy. We characterize the face of the SDP cone that corresponds to a given clique in 
the graph, thus reducing the size of the SDP problem. Then, we characterize the intersection 
of two faces that correspond to overlapping cliques. This allows us to explicitly grow/increase 
the size of the cliques by repeatedly finding the intersection of subspaces that represent the faces 
of the SDP cone that correspond to these cliques. Equivalently, this corresponds to completing 
overlapping blocks of the EDM . In this way, we further reduce the dimension of the faces until 
we get a completion of the entire EDM . The intersection of the subspaces can be found using 
a singular value decomposition (SVD) or by exploiting the special structure of the subspaces. No 
SDP solver is used. Thus we solve the SDP problem in a finite number of steps, where the work 
of each step is to find the intersection of two subspaces (or, equivalently, each step is to find the 
intersection of two faces of the SDP cone) . 

Though our results hold for general embedding dimension r, our preliminary numerical tests 
involve sensors with embedding dimension r = 2 and r = 3. The sensors are in the region [0, l] r . 
There are n sensors, m of which are anchors. The radio range is R units. 
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1.1 Related Work/ Applications 

The number of applications for distance geometry problems is large and increasing in number and 
importance. The particular case of SNL has applications to environmental monitoring of geo- 
graphical regions, as well as tracking of animals and machinery; see, for example, [5j[15]. There 
have been many algorithms published recently that solve the SNL problem. Many of these in- 
volve SDP relaxations and use SDP solvers; see, for example, [5j [HJ [91 UM HI [16] and more 
recently [231 [31]. Heuristics are presented in, for example, [H] . SNL is closely related to the 
EDMC problem; see, for example, [3j[T5] and the survey [2]. 

Jin et al [131 E3] propose the SpaseLoc heuristic. It is limited to r = 2 and uses an SDP solver 
for small localized subproblems. They then sew these subproblems together. So &; Ye [28] show 
that the problem of solving a noiseless SNL with a unique solution can be phrased as an SDP and 
thus can be solved in polynomial time. They also give an efficient criterion for checking whether a 
given instance has a unique solution for r = 2. 

Two contributions of this paper are: we do not use iterative p-d i-p techniques to solve the 
SDP , but rather, we solve it with a finite number of explicit solutions; we start with local cliques 
and expand the cliques. Our algorithm has four different basic steps. The first basic step takes 
two cliques for which the intersection contains at least r + 1 nodes and implicitly completes the 
corresponding EDM to form the union of the cliques. The second step does this when one of the 
cliques is a single element. Therefore, this provides an extension of the algorithm in [18], where 
Eren et al have shown that the family of trilateration graphs admit a polynomial time algorithm for 
computing a realization in a required dimension. 1 Our first basic step also provides an explicit form 
for finding a realization of a uniquely localizable graph 2 . Our algorithm repeatedly finds explicit 
solutions of an SDP . Other examples of finding explicit solutions of an SDP are given in [301 E2] • 

The SNL problem with given embedding dimension r is NP-hard [21 1 122 [ [27]. However, from 
our numerical tests it appears that random problems that have a unique solution can be solved 
very efficiently. This phenomenon fits into the results in [4j [19] . 

1.2 Outline 

We continue in Section [1.31 to present notation and results that will be used. The facial reduction 
process is based on the results in Section[2j The single clique facial reduction is given in Theorem l2.31 
the reduction of two overlapping cliques in the rigid and nonrigid cases is presented in Theorem 12. 101 
and Theorem l2.14l respectively; absorbing nodes into cliques in the rigid and nonrigid cases is given 
in Corollaries 12.171 and 12.181 respectively. These results are then used in our algorithm in Section [3j 
The numerical tests appear in Section 13.11 and Section 13.21 Our concluding remarks are given in 
Section 01 

1.3 Preliminaries 

We work in the vector space of real symmetric k x k matrices, S k , equipped with the trace inner 
product, (A,B) = trace AB. We let and <S++ denote the cone of positive semidefinite and 

1 A graph is a trilateration graph in dimension r if there exists an ordering of the nodes 1, . . . , r + 1, r + 2, . . . , n 
such that: the first r + 1 nodes form a clique, and each node j > r + 1 has at least r + 1 edges to nodes earlier in the 
sequence. 

2 A graph is uniquely localizable in dimension r if it has a unique realization in R r and it does not have any 
realization whose affine span is R h , where h > r; see |28| . 
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positive definite matrices, respectively; A >z B and A y B denote the Lowner partial order, 
A — B G Si and A — B G 5++ , respectively; e denote the vector of ones of appropriate dimension; 
TZ(C) and M(C) denote the range space and null space of the linear transformation C, respectively; 
cone (S) denote the convex cone generated by the set S. We use the Matlab notation 1 : n = 
{l,...,n}. 

A subset F C K is a face of the cone K, denoted F < K, if 

x,yeK, ^(x + y)eFJ =>- (cone {x , y} Q F) . 

li F <K, but is not equal to -FT, we write F <\K. If {0} 7^ F < if, then i 7 is a proper face of -FT. For 
S 1 C ET, we let face(5) denote the smallest face of .FT that contains £*. A face F < X is an exposed 
face if it is the intersection of X with a hyperplane. The cone X is facially exposed if every face 
F < K is exposed. 

The cone <S™ is facially exposed. Moreover, each face i 7 < <S" is determined by the range of 
any matrix S in the relative interior of the face, S G relint F: if S = UTU T is the compact spectral 
decomposition of S with the diagonal matrix of eigenvalues T G <S++, then (e.g., [25]) 

F = US\U T . (1.2) 

A matrix D = (Dij) G 5 n with nonnegative elements and zero diagonal is called a pre-distance 
matrix . In addition, if there exist points p±, . . . ,p n G W such that 

D ij = \\Pi -Pj\\h *>J = !.•••>«> (!-3) 

then D is called a Euclidean distance matrix, denoted EDM . Note that we work with squared 
distances. The smallest value of r such that (jl.3p holds is called the embedding dimension of D. 
Throughout the paper, we assume that r is given and fixed. The set of EDM matrices forms a 
closed convex cone in S n , denoted £ 71 . If we are given annxn partial EDM D p , let Q = (iV, £/, u>) 
be the corresponding simple graph on the nodes N = 1 : n whose edges E correspond to the known 
entries of D p , with (D p )ij = wf-, for all (i,j) G E. 

Definition 1.1. For Y G S n and a C 1 : n, we Zei ^[a] denote the corresponding principal 
submatrix formed from the rows and columns with indices a. If in addition, \a\ = k and Y G S k 
is given, then we define 

S n (a, Y) := {Y G S n : Y[a] = Y} , S"(a, Y) := {Y G S™ : = F} . 

That is, the subset of matrices Y G S n (Y G 5? j mi/i principal submatrix Y[a] fixed to Y . 

For example, the subset of matrices in S n with the top left k x k block fixed is 

S n (l:k,Y) = \ Y G S n : Y 



' Y 




} 









(1.4) 

A clique 7 C 1 : n in the graph Q corresponds to a subset of sensors for which the distances 
u ij = \\Pi — 1 1 2 are known, for all i,j G 7; equivalently, the clique corresponds to the principal 
submatrix D p [7] of the partial EDM matrix D p , where all the elements of ^[7] are known. 
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n = 100, m = 9, R = 2 



Figure 1.1: Graph of partial EDM with sensors o and anchors ■ 



Suppose that we are given a subset of the (squared) distances from (jl.3p in the form of a 
partial EDM , D p . The EDM completion problem consists of finding the missing entries of D p 
to complete the EDM ; see Figure 11.11 This completion problem can be solved by finding a 
set of points pi, . . . ,p n G M r satisfying (jl.3p . where r is the embedding dimension of the partial 
EDM, Dp. This problem corresponds to the graph realizability problem with dimension r, which 
is the problem of finding positions in K r for the vertices of a graph such that the inter-distances of 
these positions satisfy the given edge lengths of the graph. 

Let Y £ Ai n be an n x n real matrix and y £ M 71 a vector. We let diag(Y) denote the vector in 
M. n formed from the diagonal of Y and we let Diag(y) denote the diagonal matrix in M n with the 
vector y along its diagonal. Note that diag and Diag are the adjoint linear transformations of each 
other: Diag = diag*. The operator offDiag can then be defined as offDiag(Y) := Y — Diag(diag Y). 
For 



■ T 
Pi 

T 
P2 



T 

Ph. 



where pj, j = 1, . . . , n, are the points used in (11 .3f) . let Y := PP T , and let D be the corresponding 
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EDM satisfying (|1.3|) . Denning the linear operators K, and T> e on S n as follows, we see that 

K(Y) := V e (Y)-2Y 

:= diag(Y) e T + e diag(Y) T - 2Y 

= (pfPi+PjPj-ZpJPj) . (1.5) 



(llPi-Pilli)y=i 



That is, /C maps the positive semidefinite matrix Y onto the EDMD. More generally, we can 
allow for a general vector v to replace e, and define V V (Y) := diag(Y) v T + vdiag(Y) T . By abuse 
of notation, we also allow V v to act on a vector; that is, T> v {y) := yv T + vy T . The adjoint of K, is 

K*(D) = 2(Diag(Z>e) - D). (1.6) 

The linear operator tC is one-one and onto between the centered and hollow subspaces of S n , 
which are defined as 

Sc '■= {Y G S n : Ye = 0} (zero row sums), , > 

S H := {D € S n : diag(D) = 0} = ft(offDiag). ^ ^ 

Let J := I — \ee T denote the orthogonal projection onto the subspace {e} 1 - and define the linear 
operator T(D) := — i JoffDiag(D) J. Then we have the following relationships. 

Proposition 1.2. (fl^) The linear operator T is the generalized inverse of the linear operator tC; 
that is, K) = T ■ Moreover: 

U{TC) = S H ; Af(fC) = K(V e ); 
TIQC*) = Tl{T) = S c ; Af(/C*) = M(T) = ^(Diag); 1 a) 

S n = S H ® n(Diag) =S c @Tl{V e ). (1.9) 

Theorem 1.3. (\^) The linear operators T and JC are one-to-one and onto mappings between the 
cone £ n C Sh and the face of the semidefinite cone 5? H Sc ■ That is, 

T(£ n ) =S'lnS c and K{Sl n S c ) = £ n . 

Remark 1.4. D € £ n has embedding dimension r if and only if K) \D) y and rank(/C^(Z))) = r. 
In addition, we get (D)e = 0. Therefore, we can factor K){D) = PP T , for some P G M. nxr , to 
recover the ( centered) sensors in W from the rows in P. Note that rotations of the points in the rows 
of P do not change the value Y = PP T , since PP T = PQ T QP if Q is orthogonal. However, the 
nullspace of JC is related to translations of the points in P. Let D G £ n with embedding dimension r 
and let Y := IC'(D) have full rank factorization Y = PP T , with P £ A4 nxr . Then the translation 
of points in the rows of P to P := P + ew T , for some w G M. r , results in Y := PP T = Y + T> e (y), 
with y := Pw + ^e, and K{Y) = K{Y) = D, since V e (y) G N(K). Note that K{Y) = K(P), 
therefore y = Pw + ^-^-e G TZ{Y) + coneje}, as we will also see in more generality in Lemma \2.1\ 
below. 
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Let Dp G S n be a partial EDM with embedding dimension r and let W G 5 n be the 0-1 
matrix corresponding to the known entries of D p . One can use the substitution D = K.(Y), where 
Y G 5? n 5c, in the EDM completion problem 

Find D G £ n 

s.t. lfoD = WoD ! , 

to obtain the SDP relaxation 

Find Y G 5™ n 5c 
s.t. IfoK(y) = Wo £> p ' 

This relaxation does not restrict the rank of Y and may yield a solution with embedding dimension 
that is too large, if rank(Y) > r. Moreover, solving SDP problems with rank restrictions is NP- 
hard. However, we work on faces of 5" described by US+U T , with t < n. In order to find the face 
with the smallest dimension t, we must have the correct knowledge of the matrix U. In this paper, 
we obtain information on U using the cliques in the graph of the partial EDM . 

2 Semidefinite Facial Reduction 

We now present several techniques for reducing an EDM completion problem when one or more 
(possibly intersecting) cliques are known. This extends the reduction using disjoint cliques presented 
in jl6lll7|. In each case, we take advantage of the loss of Slater's constraint qualification and project 
the problem to a lower dimensional SDP cone. 

We first need the following two technical lemmas that exploit the structure of the SDP cone. 

Lemma 2.1. Let B G S n , Bv = 0, v / 0, y G R n and Y :=B + V v (y). IfY^O, then 

y G Tl{B) + cone {v}. 

Proof. First we will show that y G Ti{B) + span{v} = 1Z ([S v\\. If this is not the case, then y 
can be written as the orthogonal decomposition 

y = Bu + j3v + y, 

where ^ y G 1Z ( [B t>] ) = M ( [JB v\ . Note that y satisfies By = and v T y = 0. To get a 
contradiction with the assumption that Y >z. 0, we let 

2 \\v\\ z \\y\\ 

and observe that Bz = and v T z = 1/2. Then, 

z T Yz = z T V v {y)z 

= z T (yv T + vy T ) z 

T 

= y z 

= \P + fz 

= + 

< o, 
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which gives us the desired contradiction. Therefore, y G H(B) + span{t>}, so to show that y £ 
7Z(B) +cone{u}, we only need to show that if y = Bu +[3v, then j3 > 0. First note that v T y = f3v T v. 
Then, 

v T Yv = v T (yv T + v y T ) v 
= 2v T yv T v 
= 2f3(v T v) 2 . 

Since Y >z 0, we have 2f3(v T v) 2 > 0. This implies that /3 > 0, since □ 

If y S , then we can use the minimal face of containing Y to find an expression for the 
minimal face of 5V that contains : k, Y). 



Lemma 2.2. Let U e M kxt with U T U = I t . 7/ face {y} < US\_ If 1 ', then 



Tj 



face S?(l :fc,y) < 



Furthermore, i/face{y} = US t + U T , then 



< 


"?7 





gn—k+t 


U 







In-k 




7 n _ fc 



(2.1) 



face 5™ (1: A;, y) 



"17 





gn—k+t 


U 





In-k_ 




in-fe. 



(2.2) 



Proof. Since_y € £/S^ C/ T , then Y = USU T , for some Sg5|. Let 7 G : jfc.y) and choose 

V so that [U V] is an orthogonal matrix. Then, with Y blocked appropriately, we evaluate the 
congruence 

V 

I n -k 



-< 



y 



V o 







v t y 2 Y 




"0 " 


I n -k_ 




Y 2l V 


y 22 _ 




o y 22 _ 


= 0. Since W(y T ) = 


n(u), 


we 


set y£ 



Therefore, Y >z implies that y T 
Therefore, we can write 

T 



~U 




" s 


X~ 




~U 


I n -k_ 




X T 


y 22 _ 




I n -fc 



This implies that face 5^(1: A;, y) < US'1~ k+t U T , where 

U : 



£7 
In-k 



This proves ([21]). To prove ([22]), note that if face{T} = US\ U T then Y G relint (f/S^ *7 T ), so 
y = USU T , for some Letting 



Y 



~U 




~S 




"17 


7 n _ fe _ 




7 n _ fc _ 




.0 I n -K 



i T 



we sec that y G 5™(1 : fc, y) n relint (^S£~ fc+t f7 J J . This implies that there is no smaller face of 
5" containing 5™ (1 : /c, y), completing the proof. □ 
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2.1 Single Clique Facial Reduction 

If the principal submatrix D G £ k is given, for index set aCl:n, with \a\ = k, we define 

£ n (a, D) := {D G £ n : £>[a] = 5} . 
Similarly, the subset of matrices in £ n with the top left k x k block fixed is 

£ n (l:k,D) = {D€£ n : D 



' D 










} 



(2.3) 



(2.4) 



A fixed principal submatrix D in a partial EDM D corresponds to a clique a in the graph Q of 
the partial EDM D. Given such a fixed clique defined by the submatrix D, the following theorem 
shows that the following set, containing the feasible set of the corresponding SDP relaxation, 

{Y G SI n S c : JC(Y[a]) =D}=K) (£ n (a, D)) , 

is contained in a proper face of . This means that the Slater constraint qualification (strict 
feasibility) fails, and we can reduce the size of the SDP problem; see [16]. We expand on this and 
find an explicit expression for face K) (£ n (a,D)) in the following Theorem 12.31 For simplicity, here 
and below, we often work with ordered sets of integers for the two cliques. This simplification can 
always be obtained by a permutation of the indices of the sensors. 

Theorem 2.3. Let D G £ n , with embedding dimension r. Let D := D[l:k] G £ k with embedding 
dimension t, and B := K)(D) = JJ B SUg, where U B G M kxt , UgU B = h, and S G S l ++ . Further- 



more, let U B '■= 
orthogonal. Then 



Ub 



M kx(t+1) u .__ 









In—k 



and let 



U T e 
W 7 ^ 



G M 



n-k+t+1 



be 



face /C f (£ n (l:k,D)) = (uS 



: n-k+t+l TT T 



u T )c\s c = (uv)s , r k+t (uv) T . 



(2.5) 



Proof. Let Y G K) (£ n (l:k,D)) and Y := Y[l : k). Then there exists D G £ n (l : k,D) such that 

Y = tf(D), implying that K(Y) = D, and that K(Y) = D = K(B). Thus, Y G_ B + Af(K) = 
B + lZ(T> e ), where the last equality follows from Proposition II. 2i This implies that Y = B + D e (y), 
for some y G M. k . From Theorem 11.31 we get Y >z and Be = 0. Therefore, Lemma 12.11 implies 
that y = Bu + fie, for some uGl' and > 0. This further implies 

Y = B + Bue T + eu T B + 2/5ee T . 

From this expression for Y, we can see that U(Y) CU([B e]) = K(U B ), where the last equal- 
ity follows from the fact that Be = 0. Therefore, Y G UbS 1 ^ 1 !^^, implying, by Lemma I2.2L 
that face5"(l : k,Y) < USl~ k+t+1 U T . Since Y G : k,Y) and Ye = 0, we have that 

Y G (uSl~ k+t+1 U T ^j DS C . Therefore, face K) (£ n (l:k,D)) < (uSl~ k+t+l U T ^ D S c . Since 
V T U T e = 0, we have that 



usr k+t+1 u T ) ns c 



uvsT k+t v T u T . 



(2.6) 
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To show that face K) (£ n (l : k, D)) = (USl~ k+t+1 U T } n S c , we need to find 

Y = UZU T G K) (£ n {l:k,D)) , with rank (Y) = n - k + t, Ye = 0, Z G 5+~ fc+t+1 . (2.7) 



To accomplish this, we let Ti 
1 



'5 0' 
1 



Then T\ >- and 



£ + f ee T = U B TiUl = PP T , where P := 17 B T^ /2 G X fcx (* +1 ). 



A- 



Let 





P 





P : = 





In-k-l 




_ -e T P 


T 

— e 



A^j nx (n— fc+i) 



Since P has full-column rank, we see that P also has full-column rank. Moreover, P T e = 0. 
Therefore, 



Y := PP 



T 



■ ppT 


-e 





In-k-i — e 


T 

—e 


— e T n — 1 



GcS: 



satisfies Ye = and rank (Y) = n — k + t. Furthermore, we have that Y = UZU T , where 



' s 








" 





1 





-Vk 








In-k-l 


— e 


. 


-Vk 


T 

—e 


n — 1 



G 5 



Note that we can also write Z as 



where 



Z 



S 0' 
T 



G 5 



n-k+t+l 



Vk' 

— e 

— e T n — 1 



1 

In-k-l 

-e 



G 5 



re-fc+l 



The eigenvalues of T are 0, 1, and n, with multiplicities 1, n — k — 1, and 1, respectively. Therefore, 
rank (T) = n — k, which implies that rank {Z) = n — k + t and Z y 0. 
Letting D := JC(Y), we have that D G £ n (l:k,D), since 

D[l:k] = /C(Y[1 :*;])= /C(PP T ) = K ( B + ^ee T ) = /C(P) = P. 



k 



Therefore, Y satisfies (|2.7p . completing the proof. 



□ 



Remark 2.4. Theorem \ 2. 3\ provides a reduction in the dimension of the EDM completion problem. 
Initially, our problem consists in finding Y G <S? fl Sc such that the constraint 



K(Y[a]) = D[a), a = l:k, 
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holds. After the reduction, we have the smaller dimensional variable Z G S™~ k+t ; by construction 
Y := (UV)Z(UV) T will automatically satisfy the above constraints. This is a reduction ofk—t — 1 = 
(n — 1) — (n — k + t) in the dimension of the matrix variable. The addition of the vector e to 



the range of B, Ub '■- 



Ub -^e t has a geometric interpretation. If B = PP T , P G Ai kxt , 
then the rows of P provide centered positions for the k sensors in the clique a. However, these 
sensors are not necessarily centered once they are combined with the remaining n — k sensors. 
Therefore, we have to allow for translations, e.g. to P + ev T for some v. The multiplication 
(P + ev T )(P + ev T ) T = PP T + Pve T + ev T P T + ev T ve T is included in the set of matrices that we 
get after adding e to the range of B. Note that Pve T +ev T P T +ev T ve T = V e (y), fory = Pv+^ev T v. 

The special case k = 1 is of interest. 

Corollary 2.5. Suppose that the hypotheses of Theorem 1 2. 3\ hold but that k = 1 and D = 0. Then 
Ub = 1, U = I n , and 



face K) (S n {l : k, D)) = face K) (£ n ) = 5™ n S c = VS^V 7 



where 



V 4=e 



G M. n is orthogonal. 



(2-S 



Proof. Since k = 1, necessarily we get t = and we can set Ub = 1- 



□ 



2.1.1 Disjoint Cliques Facial Reduction 

Theorem 12.31 can be easily extended to two or more disjoint cliques; see also [TO] . 

Corollary 2.6. Let DgP with embedding dimension r. Let ko := 1 < k\ < . . . < ki < n. For i = 

1, . . . ,1, let Di := D[ki^\ G £ k i~ k i-i+ 1 with embedding dimension t{, Bi := /C^(l)j) = UsiSU^., 

eM kx{t ' +1) . Let 



where U Bl G M kxk , U^U Bi = I u , Si G S^ + , and U Bl : 

~U Bl ... 



u 







u Bl o 

I n -k, 



and 



V 



U T e 



\U T e\\ 



G M ™- fc *+£'=i be orthogonal. Th 



en 



PL face K) (£»(h-i ■h,D i )) = ( USl~ kl+Y} ^ U+l U T ) f 



([/y)cS™" fci+E ' =i * i+ ' _1 (c/f) t . 



(2.9) 



Proof. The result follows from noting that the range of U is the intersection of the ranges of the 
matrices U Bi with appropriate identity blocks added. □ 
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0- 2 













1 h 



Figure 2.1: Venn diagram of the sets of ordered indices, ot\ and a 2 , in Theorem [2? 
2.2 Two (Intersecting) Clique Facial Reduction 



The construction (|2.6[) illustrates how we can find the intersection of two faces. Using this approach, 
we now extend Theorem 12. 31 to two cliques that (possibly) intersect; see the ordered indices in (|2.10p 
and the corresponding Venn diagram in Figure 12.11 We also find expressions for the intersection 
of the corresponding faces in ; see equation (12.120 . The key is to find the intersection of the 
subspaces that represent the faces, as in condition (|2.1ip . 

Theorem 2.7. Let D G £ n with embedding dimension r and, as in Figure [Oj, define the sets of 
positive integers 

a\ := l:(k~i + k 2 ), _a 2 := (&i + l):(ki + k 2 + £3) C l:n, 

ki := \ai\ = k\ + k 2 , k 2 :=_|«2| = k 2 + k 3 , (2.10) 
k := k~i + k 2 + fc 3 . 

For i = 1,2, let D{ := D[aj] G £ ki with embedding dimension ti, and Bi := JC'(Z)j) = UiSiOJ ', 



where U { G .M fe * x *° ; = I ti; 5j G and U, 

U (zM kx{t+l) satisfy 

"C/i 



G .M fc * x . Lei t and 



4, 



n7e 



, with U T U = I t+1 . 



Let U :-- 



U 

I n -k 
2 



M nx(n-k+t+l) md 



V 



u 2 

G rt - fc +* +1 6 e orthogonal. Then 



(2.11) 



Iic/ T 



t=i 



p| face K) (£ n (a h A)) = ([AS"- fc+m ?7 T ) D S c = (UV)Sl~ k+t (UV) T . (2.12 



Proof. From Theorem 12.31 we have that 





I 


" Ui 







" ?7i 








face K) (S n (ai,Di)) = 





















V 





In-k 










In—k 


after a permutation of rows 


and columns in Theorem 12.31 










< 

















face K) (£ n (a 2 ,D 2 )) = 




u 2 





^n-fc2+<2+l 





£/ 2 







V 





In—k 










In-k 



n So- 



li 



The range space condition (|2.1ip then implies that 



TZ(U) = 1Z 



giving us the result (12.121) . 

























In-k 



nil 

























I n -k 



□ 

Remark 2.8. Theorem \2.1\ provides a reduction in the dimension of the EDM completion problem. 
Initially, our problem consists in finding Y £ 5? n Sc such that the two constraints 



K(Y[ai\) = D[ai], 



1.2, 



hold. After the reduction, we want to find the smaller dimensional Z G 5? k+t ; by construction 
Y := (UV)Z(UV) T will automatically satisfy the above constraints. 



The explicit expression for the intersection of the two faces is given in equation (|2.12|) and uses 
the matrix U obtained from the intersection of the two ranges in condition (|2.1ip . Finding a matrix 
whose range is the intersection of two subspaces can be done using j20t Algorithm 12.4.3]. However, 
our subspaces have special structure. We can exploit this structure to find the intersection; see 
Lemma (|2.9p and Lemma ()2. 13[) below. 

The dimension of the face in (|2.12p is reduced to n — k + t. However, we can get a dramatic 
reduction if we have a common block with embedding dimension r, and a reduction in the case 
the common block has embedding dimension r — 1 as well. This provides an algebraic proof using 
semidefinite programming of the rigidity of the union of the two cliques under this intersection 
assumption. 



2.2.1 Nonsingular Facial Reduction with Intersection Embedding Dimension r 

We now consider the case when the intersection of the two cliques results in D[a\ n a 2 ] having 
embedding dimension r; see Figure 12.21 We see that we can explicitly find the completion of the 




Figure 2.2: Two clique reduction with intersection with embedding dimension r 
EDM D[ai\Jct2\- We first need the following result on the intersection of two structured subspaces. 
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Lemma 2.9. Let 



U 



1 •= 



r + l 

u'( 



Uo 



k 

S2 



r+l 



u 



1 •= 





r+l 


S2 




si 


r+l 


si 


r u[ 


" 




" I 





k 


u» 





, U 2 ■= k 







S2 





I 


S2 





u' 2 



be appropriately blocked with U", U 2 G M fex ( r + 1 ) full column rank and TZ(U") = 1Z(U 2 ). Further- 
more, let 

r+l r+l 



U'( 



Uo r- 



si 
k 

S2 



l<2 



(2.13) 



Then U\ and U 2 are full column rank and satisfy 

ft(c/i) n n(u 2 ) = n (c?i) = n {u 2 ) . 

Moreover, if e r +i G W +1 is the (r + l) st standard unit vector, and Ue r +i = one, for some cti ^ 0, 
for i = 1,2, then U{e r +\ = a^e, /or z = 1,2. 

Proof. From the definitions, x G H(Ui) n 1Z{U 2 ) if and only if 













^2 










_ x 3_ 




1>2 




_U 2 w 2 _ 











some u = 




, w = 






^2 




u; 2 _ 



Note that JTfwi = U 2 w 2 if and only if w 2 = (U^^U^vi; this follows from the facts that U 2 full 
column rank implies (U^Ug = I, and K(U'{) = K{U%) implies U' 2 \U' 2 ^U'{ = U'{. Therefore, 
x G K{Ui) n K{U 2 ) if and only if 





XI 




X = 


x 2 






. X 3. 





U[ Vl 
U'(v x 
U' 2 {U' 2 ^U'{v x 



UiVi, for some v±, 



with v 2 := U' 2 {U^Ulv u w x := U[vi, and w 2 := (UfflUfvu implying that ft(f/i)nft(t/ 2 ) = K{U X ); 
a similar argument shows that 1Z{U\) n 1Z(U 2 ) = 1Z(U 2 ). 

Now suppose, for i = 1,2, that c^e r+ i = c^e, for some ctj 7^ 0. Then e G TZ{U\) CilZ(U 2 ), 

so e G TZ(Ux), implying that U\v = e, for some vector v. Since j/i : 



u> 2 {u»yu>> 
1 



we have 



U\v = e. Furthermore, since U\ has full column rank, we conclude that v = ^-e r +i, implying that 
Uie r +i = a\e. Similarly, we can show that [7 2 e r +i = a 2 e. □ 

We now state and prove a key result that shows we can complete the distances in the union of 
two cliques provided that their intersection has embedding dimension equal to r. 



Theorem 2.10. Let the hypotheses of Theorem 2.1 hold. Let 

/3C ai na 2 , D:=D\fl, B:=K ] {D), Up := U[/3,:}, 
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where U G M fcx (* +1 ) satisfies equation ([2TTj) . lei 



r 



G .M <+1 6e orthogonal. Let 



Z := (JUpV)^B{{JU p V) 



tvr 



(2.14) 



7/ i/te embedding dimension for D is r, then t = r, Z G 51, is i/ie unique solution of the equation 



and 



{JtJpV)Z{JUpV) T = B, 

D[ax U a 2 ] = /c ((i7y)z(i/y) T ) 



(2.15) 
(2.16) 



Proof. Since the embedding dimension of D is r, we have rank (B) = r. Furthermore, we have 
Be = and B G sP\ implying that |/3| > r + 1. In addition, since the embedding dimension of D is 
also r, we conclude that the embedding dimension of Di is r, for i = 1,2. Similarly, the embedding 
dimension of D[a\ n a 2 ] is also r. 

Since C7 G M fcx (* +1 ) satisfies equation (pTTj) . we have that 



n(u) = n 

Note that we have partitioned Ui 



U[ 

u'l 

/ 







'fcl 



C/ 2J 



G M^x^ 1 ) so that U" 



j^\a 1 na2\x(r+i) ^ £ Qr ^ _ -^ 2, Moreover, we have used the fact that the embedding dimension 
of Di is r, so that t{ = r, for i = 1,2. 

We claim that U" and U' 2 ' have full column rank and that K{U") = 1l(U%). First we let 
Y := K^(D[a 1 Ua 2 ]). Then Fetf (£ fc («i, A)) • By Theorem E3J there exists Zi G S+ 3+r+1 such 
that 





\w 


" 






" 


y = 









u>{ 







_ 


h 3 . 




_ 





Therefore, Y[ ai n a 2 ] = [£/{' 0] Zi [U'{ 0] T G U'{S^\U'{f , so 

W(Y[ai H a 2 \) C ft(lTj')- 

Furthermore, since /C(y) = D[aiUa 2 ], we have that /C(y[aina 2 ]) = £>[aina 2 ] = K (K){D[a x n a 2 ])) , 
so y[ai n a 2 ] G KJ(D[a\ n a 2 ]) + MQC). Since MQC) = lZ{V e )^ there exists a vector y such that 

y[ai n a 2 ] = K, ] {D[ai n a 2 ]) + P e (y) = /C f (L>[ai n a 2 ]) + ye T + ey T . 

By Lemma EH y G ft ( [K) (D [a\ n a 2 ] ) e] ) . Therefore, 

TZ(Y[a 1 na 2 ])=TZ([lC\D[a 1 na 2 }) e]) . 

Moreover, rank /C' (-D[«i fl a 2 ]) = r and KJ(D[ai D a 2 ])e = 0, so 

r + 1 = dim^(y[ai n a 2 ]) < dimft(f7f) < r + 1. 
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Therefore, U" has full column rank and TZ(U") = lZ(Y[ai n 02])- Similarly, we can show that U'-l 
has full column rank and = TL{Y\a\ H 02]), so we conclude that TZ(U'{) = THU^). 

We now claim that t = r, where U G M kx( - t+1 ^ satisfies equation (|2.1ip . Since f/f , L^' G 
X l«ina 2 |x(r+i) have fuU column rank and n{U'{) = TZ{U^), we have by Lemma ESI that K(U) = 

n(Ui) = TZ(U 2 ), where 



u>{ 



and U2 '■- 



u 2 



Therefore, 



i + 1 = dimK(U) = dimft(Lq) = dim^(J7 2 ) = r + 1, 



so we have t = r, as claimed. 

Recall, y = /C 1 " U a 2 ]), so 7 £ 1^=1,2 £ f (£ k (ai, A))- Thus, Theorem O implies that 
there exists such that Y = [UV)Z{UV) T . Observe that K(Y\jS\) = D[/3] = D. Thus, 



K {{UpV)Z{UpV) T ) = D, 

implying that 

tfK,((U fj V)Z{UpV) T )=B. 

Since K) K. is the projection onto 1Z(K*) = Sc, we have that KJ /C(-) = J{-)J. Therefore, we have 
that Z satisfies equation (j2. 15|) . It remains to show that equation (I2.15|) has a unique solution. Let 
A := JUpV G M l/3|xr . Then AZA T = B and rank (B) = r implies that rank (A) > r, so A has full 
column rank. This implies that equation (I2.15P has a unique solution, and that Z = A^B(A^) T = Z. 
Finally, since Y = (UV)Z(UV) T and D[a x U a 2 ] = K(Y), we get equation (12151) . □ 

The following result shows that if we know the minimal face of 5? containing )C*(D), and we 
know a small submatrix of D, then we can compute a set of points in K r that generate D by solving 
a small equation. 

Corollary 2.11. Let D G £ n with embedding dimension r, and let fi C l:n. Let U G 7V^ nx ( r + 1 ) 
satisfy 

face /C* (D) = (US r + +1 U T ) n 5 C , 



Zei t/g := C/[/3,:] ; and ZeZ 
then 



V 



G .M r+1 6e orthogonal. If D\J3] has embedding dimension r, 



(JUpV)Z(JUpVf =tf{D\p\) 
has a unique solution Z G and D = K.{PP T ), where P := UVZ 1 / 2 G R nxr . 

Proof. Apply Theorem 12.101 with a,\ = a 2 = 1 : n. 

Remark 2.12. A more efficient way to calculate Z uses the full rank factorization 

T 



□ 



B = QD 1/2 ( QD 



,1/2 



Q T Q = I r , D G s; + . 

Lei C = (JUpVy (QD 1 / 2 ) . Then Z in ([2Tl]) can be found from Z = CC T . Note that our algorithm 
postpones finding Z until the end where we can no longer perform any clique reductions. At each 
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iteration, we compute the matrix U that represents the face corresponding to the union of two 
cliques; U is chosen from one of Ui, for i = 1,2 in (I2.13p . Moreover, for stability, we maintain 
tj T U = I, Ue r+1 = ae. 

For many of our test problems, we can repeatedly apply Theorem \2.10\ until there is only one 
clique left. Since each repetition reduces the number of cliques by one, this means that there are at 
most n such steps. 



2.2.2 Singular Facial Reduction with Intersection Embedding Dimension r — 1 




Figure 2.3: Two clique reduction with intersection having embedding dimension < r 



We now show that if the embedding dimension of the intersection is r — 1 (i.e., deficient), then 
we can find at most two completions. If exactly one of these two completions is feasible in the 
sense that it satisfies the related distance equality constraints and, if included, the related lower 
bound inequality constraints obtained from the radio range R, then we have identified the unique 
completion; see Figure [2731 We first need the following extension of Lemma 12.91 on the intersection 
of two structured subspaces for the case where the common middle blocks are not full rank. 



Lemma 2.13. Let Ui,Ui,Ui, for i = 1,2, be defined and appropriately blocked as in Lemma W. 
with U'l G M kx( - r+1) having rank r, for i = 1,2, and 11{U'{) = 11{U%). Let ^ Ui G M(JJV), for 
i = l,2. IfUeM fcx{<+1) satisfies TZ{U) = TZ(Ut) n K(U 2 ), then t = r + l and 



K(U) 



K 



K 





o 



K U 



u[{u»yu» U[ Ul 
u'l 

U' 2 



n 




(2.17) 



Moreover, if e r +\ G W +1 is the (r + l) st standard unit vector, and Uie r +\ = c^e, for some a-i ^ 0, 
for i = 1, 2, then Uie r+ \ = a^e, for i = 1,2. 
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Proof. From the definitions, x G TZ(U) if and only if 



Xl 








Wl 






Ufa 




U 2 'w 2 


, X 3_ 




V 2 




_U' 2 W2_ 





Vl 




Wl 


some v = 




,w = 






V 2 _ 




W 2 



(2.18) 



Since TZ(U") = 1Z(U 2 ), and U",i = 1,2, are both rank r, we conclude that X2 = U'{v\ = U 2 W2, for 
some vi,W2 if and only if X2 G TZ (U"), with vi,W2 determined by 



Vl 



(U")^X2 + aiui, for some ai G 
In other words, we get 



W2 = (U^yU'iVi + CK2U2, for some 02 G 



£2 = = U2W2, for some Vi,i02) 
if and only if 

X2 = U"vi, for some ui, with W2 = (U 2 yU'{vi + 02^2 j f° r some a 2 G 



(2.19) 



After substituting for V2 with V2 = U 2 W2 = U 2 ({U 2 yU'{vi + 02^2)1 we conclude that f|2. 18j) holds 
if and only if the first equality in (12.17|) holds; i.e., (12.18|) holds if and only if 





Xl 




X = 


X2 






_ X 3_ 





U{vi 
U'{vi 

U' 2 {U^U'{vi + a 2 U' 2 u 2 



for some vi , ct2, 



where 



V2 = U'^U'^UiVi + a 2 U 2 U2, wi = U[vi, w 2 = {U 2 yUlvi + a 2 U2- 

The second equality in ()2. 17[) follows similarly. The last statements about £/je r +i follow as in 
the proof of Lemma 12.91 □ 



In the rigid case in Theorem 12.101 we use the expression for U from Lemma 12.91 to obtain a 
unique Z in order to get the completion of D[ai U 02]. The Z is unique because the r + 1 columns 
of U that represent the new clique aci U 02 are linearly independent, e G 1Z(U), rank(S) = r, 
and Be = 0. This means that the solution C of {JUpV)C = QD 1 / 2 in Remark 12.121 exists and is 
unique. (Recall that JUgV is full column rank.) This also means that the two matrices, Ui and U2, 
that represent the cliques, ai and 02, respectively, can be replaced by the single matrix U without 
actually calculating C; we can use U to represent the clique «i U 02 and complete all or part of the 
partial EDM D[oti U a%\ only when needed. 

We have a similar situation for the singular intersection case following Lemma 12.131 We have 
the matrix U to represent the intersection of the two subspaces, where each subspace represents 
one of the cliques, oti and 02- However, this is not equivalent to uniquely representing the union of 
the two cliques, «i and CK2, since there is an extra column in U compared to the nonsingular case. 
In addition, since rank (B) = r — 1, then JUpV is not necessarily full column rank. Therefore, there 
may be infinite solutions for C in Remark [2. 12\ any C G (JUpV)^ (QD 1 / 2 ) +M(JUpV) will give us 
a solution. Moreover, these solutions will not necessar ily satisfy K ((UC){UC) T ) = D[aiUo 3 ]. We 
now see that we can continue and use the U to represent a set of cliques rather than just ai U 02- 
Alternatively, we can use other relevant distance equality constraints or lower bound constraints 
from the radio range R to determine the correct C in order to get the correct number of columns 
for U; we can then get the correct completion of D[ai U 02] if exactly one of the two possible 
completions with embedding dimension r is feasible. 
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Theorem 2.14. Let the hypotheses of Theorem \2.10\ hold with the special case that UfUi = I, 
Uie r +\ = one, for i = 1,2. In addition, let U be defined by one of the expressions in (I2.17P in 
Lemma \2.13\ For i = 1,2, let f3 C Si C cn and A{ := JUsjV, where Ug i := U(d~i, '■)■ Furthermore, 
let Bi := )0(D[di]) ; define the linear system 



AiZAj = B 1 
A 2 ZAl = B 2 , 



(2.20) 



and let Z £ 5* be a particular solution of this system (|2.20p . If the embedding dimensions of D[5\\ 
and D[5 2 ] are both r, but the embedding dimension of D := D[f3] is r — 1, then the following holds. 

1. dimAf(A) = 1, for i = 1,2. 

2. For i = 1,2, let rii G Af(Ai), \\ni\\2 = 1, and AZ := n\n^ + n 2 n^ . Then, Z is a solution of 
the linear system (|2.20p if and only if 

Z = Z + tAZ, for some r£l. (2.21) 



3. There are at most two nonzero solutions, t\ and t 2 , for the generalized eigenvalue problem 
-AZv = tZv, v^O. Set Z t := Z + ±AZ, for i = 1,2. Then 

D[ ai U a 2 ] e {JC{UVZiV T U T ) : i = 1, 2} . 

Proof. We follow a similar proof as in the nonsingular case. For simplicity, we assume that 5i = oti, 
for i = 1, 2 (choosing smaller <5j can reduce the cost of solving the linear systems). 

That a particular solution Z exists for the system (I2.20p . follows from the fact that U provides 
a representation for the intersection of the two faces (or the union of the two cliques). 

Since the embedding dimension of D is r — 1, we have rank (B) = r — 1. Furthermore, we have 
Be = and B € S+ , implying that |/3| > r. Without loss of generality, and for simplicity, we 
assume that = r. Therefore, there exists ^ 6 J\f(U-'), for i = 1,2. From Lemma 12.131 we 
can assume that we maintain UfUi = I, Uie r +\ = cue, for some ^ 0, for i = 1,2. Therefore, 
the action of V is equivalent to removing the r + 1 column of U{. We can then explicitly use U{ to 
write down nj G M(Ai). By construction, we now have A^inin^ + U2nJ)Af = 0, for i = 1,2. 

From the first expression for U in (|2.17p . we see that the choices for n\ and n 2 in Part [1] are 
in the appropriate nullspaces. The dimensions follow from the assumptions on the embedding 
dimensions. 

Part [2] now follows from the definition of the general solution of a linear system of equations; 
i.e., the sum of a particular solution with any solution of the homogeneous equation. 

Part [3] now follows from the role that U plays as a representation for the union of the two 
cliques. □ 

Remark 2.15. As above in the nonsingular case, a more efficient way to calculate Z uses the full 
rank factorization 

B i = QD l l 2 (Q i D 1 i ,2 Y , QjQ^Ir, A € S r ++ , i = 1,2. 

(We have assumed that both have embedding dimension r, though we only need that one does.) We 
solve the equations AiC = (Qj-D^ 2 ) Qi, QiQJ = I, for i = 1,2, for the unknowns C, and Qi, 
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for i = 1,2. Then a particular solution Z in (|2.20p can be found from Z = CC T . Note that the 
additional orthogonal matrices Qi, for i = 1,2 are needed since, they still allow AiC(AiC) T = B{, 
for i = 1, 2. Also, without loss of generality, we can assume Q\ = I. 

2.3 Clique Initialization and Node Absorption 

Using the above clique reductions, we now consider techniques that allow one clique to grow/absorb 
other cliques. This applies Theorem 12.101 We first consider an elementary and fast technique to 
find some of the existing cliques. 

Lemma 2.16. For each i £ {1, . . . , n}, use half the radio range and define the set 

Ct:= {j €{!,..., n}: D tJ < (R/2) 2 } . 
Then each C{ corresponds to a clique of sensors that are within radio range of each other. 

Proof. Let j, k £ Ci for a given i G {1, . . . , n}. An elementary application of the triangle inequality 
shows that yJ{D jk ) < ^{Dji) + y/iD ki ) <R. □ 

We can now assume that we have a finite set of indices C C Z + corresponding to a family of 
cliques, {Cj}j g c. We can combine cliques using the reductions given in Theorems 12.101 and 12.141 
We now see how a clique can grow further by absorbing individual sensors; see Figure 12.41 
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Figure 2.4: Absorption with intersection having embedding dimension r 



Corollary 2.17. Let C^, for k £ C, be a given clique with node I £ Cf~, (3 := {ji, . . . ,j r +i} Q Ck> 
such that the distances Dy., for i = 1, . . . ,r + 1 are known. If 

rank K) {D [/?]) = r, (2.22) 

then I can be absorbed by the clique Ck and we can complete the missing elements in column (row) 
I ofD[C k U{l}}. 

Proof. Let ai := C^, «2 '■= {ji> • • • > jr+iJ}, and j3 := ct\C\ct2 = {ji, ■ • ■ ,j r +i}- Then the conditions 
in Theorem 12.101 are satisfied and we can recover all the missing elements in D[C k U {/}]. □ 
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2.3.1 Node Absorption with Degenerate Intersection 

We can apply the same reasoning as for the clique reduction in the nonsingular case, except now 
we apply Theorem 12.141 To obtain a unique completion, we test the feasibility of the two possible 
completions against any related distance equality constraints or, if included, any related lower 
bound inequality constraints. See Figure [231 
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Figure 2.5: Degenerate absorption with intersection with embedding dimension < r 



Corollary 2.18. Let Ck, for k £ C, be a given clique with node I £ Ck, /3 := . . . j r } C Ck such 
that the distances Dij. , for i = 1 , . . . , r are known. If 

rank = r-l, (2.23) 

then we can determine two possible completions of the distances. If exactly one of these two com- 
pletions is feasible, then I can be absorbed by the clique Ck- We can also complete the missing 
elements in column (row) I of D[Ck U {£}]. 

Proof. Let a\ := Ck, «2 '■= {ji, ■ ■ ■ ,jr,l}, and (3 := a± D «2 = {ji, ■ ■ ■ > Jr}- Then the conditions in 
Theorem 12.141 are satisfied and we can recover all the missing elements in D[Ck U {I}]. □ 

3 SNLSDPclique Facial Reduction Algorithm and Numerical Re- 
sults 

Our SNLSDPclique algorithm starts by forming a clique Cj around each sensor i. If and when we 
use this clique, we find a subspace representation from the r eigenvectors corresponding to the r 
nonzero eig envalues of B = Kt(D[Ci]). 

The algorithm then grows and combines cliques using Theorem 12.101 Theorem 12.141 Corol- 
lary (2TTZ1 and Corollary 12.181 In particular, we do not complete the EDM each time we combine 
or grow cliques; i.e., we do not evaluate the missing distances. Instead, we use the subspace rep- 
resentations of the corresponding faces of the SDP cone and then find the intersection of the 
subspaces that represent the faces. This yields a subspace representation of the new smaller face 



23 



representing the union of two cliques. This is based on Lemma [2. 91 and Lemma [2 . 1 3 1 and is therefore 
inexpensive. 

Once we cannot, or need not, grow cliques, we complete the distances using Corollary 12.111 
This is also inexpensive. Finally, we rotate and translate the anchors to their original positions 
using the approach outlined in [16]. We have provided an outline of our facial reduction algorithm 
SNLSDPclique in Algorithm CD 

3.1 Numerical Tests 

Our tests are on problems with sensors and anchors randomly placed in the region [0, l] r by means 
of a uniform random distribution. We vary the number of sensors from 2000 to 10000 in steps of 
2000, and the radio range R from .07 to .04 in steps of —.01. We also include tests on very large 
problems with 20000 to 100000 sensors. In our tests, we did not use the lower bound inequality 
constraints coming from the radio range; we only used the equality constraints coming from the 
partial Euclidean distance matrix. Our tests were done using the 32-bit version of Matlab R2009b 
on a laptop running Windows XP, with a 2.16 GHz Intel Core 2 Duo processor and with 2 GB of 
RAM. The source code used for running our tests has been released under a GNU General Public 
License, and has been made available from the authors' websites. 

We in particular emphasize the low CPU times and the high accuracy of the solutions we obtain. 
Our algorithm compares well with the recent work in [261 131| . where they use, for example, R = .06 
for n = 1000, 2000, R = .035 for n = 4000, R = .02 for n = 10000, and also use 10% of the sensors 
as anchors and limit the degree for each node in order to maintain a low sparsity for the graph. 

Tables 13.11 13.21 and 13.31 contain the results of our tests on noiseless problems. These tables 
contain the following information. 

1. # sensors, r, # anchors, and R: We use m = (^anchors), n = (^sensors) + (^anchors), 
and r to generate ten random instances of p\ , . . . , p n € M r ; the last m points are taken to be 
the anchors. For each of these ten instances, and for each value of the radio range R > 0, we 
generate the the n x n partial Euclidean distance matrix D p according to 

(D )■■ I H^* — II 2 ' if \\Pi ~ Pj\\ < R-> or both pi and pj are anchors 
[unspecified, otherwise. 

2. # Successful Instances: An instance was called successful if at least some, if not all, of the 
sensors could be positioned. If, by the end of the algorithm, the largest clique containing the 
anchors did not contain any sensors, then none of the sensor positions could be determined, 
making such an instance unsuccessful. 

3. Average Degree: We have found that the average degree of the nodes of a graph is a good 
indicator of the percentage of sensors that can be positioned. In the results reported, we give 
the average of the average degree over all ten instances. 

4. # Sensors Positioned: We give the average number of sensors that could be positioned 
over all ten instances. Note that below we indicate that the error measurements are computed 
only over the sensors that could be positioned. 
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Algorithm 1: SNLSDPclique - a facial reduction algorithm 



input : Partial n x n Euclidean Distance Matrix D p and anchors A G ]R mxr ; 
output: X G M) Ci \ xr , where C is the largest final clique that contains the anchors; 

1 Let C := {l,...,n + l}; 

2 Let {Cjjjgc be a family of cliques satisfying i G C, for all i = 1, . . . , n; /* For example, by 
Lemma [2 . 161 . we could choose d := {j : (D p )ij < (R/2) 2 } , for i = 1, ...,n. 
Alternatively, we could simply choose Cj := {i} , for i = l,...,n. */ 

3 Let C n +i := {n — m + 1, . . . , n}; /* C n +i is the clique of anchors */ 

/* GrowCliques */ 

4 Choose MaxCliqueSize > r + 1; /* For example, MaxCliqueSize := 3(r + 1) */ 

5 for i G C do 



6 
7 

8 

9 end 



while (]Cj| < MaxCliqueSize^ and (3 a node j adjacent to all nodes in Ci) do 

| Ci := Ci u 0"}; 
end 



/* ComputeFaces */ 
10 for i G C do 

n Compute C/b 4 G IRl c ''l x ( r+1 ) to represent face for clique C; /* see Theorem 12 . 31 */ 
/* Alternatively, wait to compute UB i when first needed. This can be more 
efficient since is not needed for every clique. */ 

12 end 

13 repeat 

14 
15 
16 
17 
18 
19 
20 
21 
22 



if |Cj n Cj\ > r + 1, /or some i, j G C then 

RigidCliqueUnion(CCj); /* see Algorithm [2] */ 

else if |Cj fl A/"(j)| > r + 1, /or some i G C and node j then 

RigidNodeAbsorption(CJ) ; /* see Algorithm [3] */ 

else if |Cj n C,-| = r, for some i,j G C then 

NonRigidCliqueUnion(CCj) ; /* see Algorithm H] */ 

else if |Cj n = r, for some i G C and node j then 

NonRigidNodeAbsorption(Cj) ; /* see Algorithm [5] */ 

end 

23 until not possible to decrease \C\ or increase |Cj| for some i G C; 

24 Let Ci be the largest clique that contains the anchors; 

25 if clique Ci contains some sensors then 
Compute a point representation P G Rl^l* 7 " for the clique C; /* see Cor. 12 . Ill */ 
Compute positions of sensors X G R(l c ' i l _m ) xr in clique C by rotating P to align with 
anchor positions A G M mxr ; /* see Ding et al. [fl6l . Method 3.2] */ 
return X; 

29 else 

30 | return X := 0; 

31 end 
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Algorithm 2: RigidCliqueUnion 



input : Cliques Cj and Cj such that |Cj Pi Cj\ > r + 1; 

1 Load f/Bj £ Rl c ' i l x ( r + 1 ) and t/g. £ ]Rl c 'jl x ( r '+ 1 ) representing the faces corresponding to the 
cliques Cj and Cj, respectively; 

2 Compute U E Ml c i uC jl x ( r + 1 ) using one of the two formulas in equation f|2. 13j) from 
Lemma 12.91 where U\ = Ub^, U2 = Ubj, and k = |Cj n Cj\; /* see Theorem 12 . 71 */ 

3 Update Ci := Cj U C,-; 

4 Update £7^ := U; 

5 Update C := C \ {j}; 



Algorithm 3: RigidNodeAbsorption 



input : Clique Ci and node j such that |Q D A/"(j)| > r + 1; 

1 Load £7bj G ]^|Ci|x(r+i) re p resen ting the face corresponding to clique Cf, 

2 if Ci Pi A/"(j) not a clique in the original graph then 
Use Ub 1 to compute a point representation Pj E Rl^l^ of the sensors in C,; 

/* see Cor. 12. Ill */ 
Use Pi to compute the distances between the sensors in Ci nAf(j); 

5 end 

6 Use the distances between the sensors in (Cj C\Af(j)) U {j} to compute the matrix 
Ubj E ]R(l c ' iri ^^)l +1 ) >< ( r+1 ) representing the face corresponding to the clique 

(Cj nW(j)) U {j}; /* see Theorem EH */ 

7 Compute U E ]R(l Ci l+ 1 ) x ( r+1 ) using one of the two formulas in equation (|2.13p from 
Lemma 12^9} where Ui = U Bi , U 2 = U Bj , and k = |Cj n jV(j)|; /* see Theorem [2771 */ 

8 Update Cj := Cj U {j}; 

9 Update Ub, ■= U; 



Algorithm 4: NonRigidCliqueUnion 

input : Cliques Cj and Cj such that |Cj Pi Cj\ = r; 

1 Load UBi E IRl c ' i l x ( r + 1 ) and Ubj E ]Rl C jl x ( r+1 ) representing the faces corresponding to the 
cliques Cj and Cj, respectively; 

2 Using UBi and JTg . , find the two point representations of the sensors in Cj U Cj ; 

/* see Theorem 12. 141 */ 

3 if exactly one of these two point representations is feasible then 

4 Use the feasible point representation to compute U E IRl c ' iUC 'il x ( T '+ 1 ) representing the face 
corresponding to the clique Cj U Cj\ /* see Theorem 12 . 31 */ 

5 Update Cj := Cj U Cj; 

6 Update Ub, := U; 

7 Update C :=C\{j}; 

8 end 
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Algorithm 5: NonRigidNodeAbsorption 



input : Clique Cj and node j such that |Cj P\J\f(j)\ = r; 

1 Load Ub { E IRl c ' i l x ( r + 1 ) representing the face corresponding to clique Cj; 

2 if Cj n A/"(j) noi a clique in the original graph then 
Use Ub 1 to compute a point representation Pi E ]Rl c '»l xr of the sensors in Cj; 

/* see Cor. 12. Ill */ 
Use Pj to compute the distances between the sensors in Ci C\N(j); 

5 end 

6 Use the distances between the sensors in (Cj n U {j} to compute the matrix 
Ubj E ]R(l c ' iri ^^)l +1 ) x ( r+1 ) representing the face corresponding to the clique 

(Ci nA/"(j)) U {j}; /* see Theorem EH */ 

7 Using fTg. and JTb. , find the two point representations of the sensors in Cj U {j}; 

/* see Theorem 12. 141 */ 

8 if exactly one of these two point representations is feasible then 
Use the feasible point representation to compute U E Rl c ' iUC 'il x ( r + 1 ) representing the face 
corresponding to the clique Cj U {j}; /* see Theorem 12 . 31 */ 

10 Update Cj := Cj U {j}; 
n Update UBi ■= U ; 
12 end 



5. CPU Time: Indicates the average running time of SNLSDPclique over all ten instances. 
This time does not include the time to generate the random problems, but it does include 
all aspects of the Algorithm Q] including the time for GrowCliques and ComputeFaces at the 
beginning of the algorithm. 

6. Max Error: The maximum distance between the positions of the sensors found and the true 
positions of those sensors. This is defined as 

Max Error := max ||jPj — £>j™ e ||2- 

i positioned 

7. RMSD: The root-mean-square deviation of the positions of the sensors found and the true 
positions of those sensors. This is defined as 

RMSD := | V \\pi - 

\ # positioned 

\ i positioned 

We note that for each set of ten random instances, the Max Error and RMSD values reported are 
the average Max Error and average RMSD values over the successful instances only; this is due to 
the fact that an unsuccessful instance will have no computed sensor positions to compare with the 
true sensor positions. 

We have three sets of tests on noiseless problems. 




1. In Table [3711 we report the results of using only the RigidCliqueUnion step (see Figure [272 
to solve our random problems. 
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Table 3.1: Results of Algorithm Q] on noiseless problems, using step RigidCliqueUnion. The values 
for Average Degree, # Sensors Positioned, and CPU Time are averaged over ten random instances. 
The values for Max Error and RMSD values are averaged over the successful instances. 











# Successful 


Average 


# Sensors 








# sensors 


r 


# anchors 


R 


Instances 


Degree 


Positioned 


CPU Time 


Max Error 


RMSD 


2000 


2 


4 


.07 


9/10 


14.5 


1632.3 


1 s 


6e-13 


2e-13 


2000 


2 


4 


.06 


5/10 


10.7 


720.0 


1 s 


le-12 


4e-13 


2000 


2 


4 


.05 


0/10 


7.5 


0.0 


1 s 






2000 


2 


4 


.04 


0/10 


4.9 


0.0 


1 s 






4000 


2 


4 


.07 


10/10 


29.0 


3904.1 


2 s 


2e-13 


6e-14 


4000 


2 


4 


.06 


10/10 


21.5 


3922.3 


2 s 


6e-13 


2e-13 


4000 


2 


4 


.05 


10/10 


15.1 


3836.2 


2 s 


4e-13 


2e-13 


4000 


2 


4 


.04 


1/10 


9.7 


237.8 


2 s 


le-13 


4e-14 


6000 


2 


4 


.07 


10/10 


43.5 


5966.9 


4 s 


3e-13 


8e-14 


6000 


2 


4 


.06 


10/10 


32.3 


5964.4 


4 s 


2e-13 


7e-14 


6000 


2 


4 


.05 


10/10 


22.6 


5894.8 


3 s 


3e-13 


le-13 


6000 


2 


4 


.04 


10/10 


14.6 


5776.9 


3 s 


7e-13 


2e-13 


8000 


2 


4 


.07 


10/10 


58.1 


7969.8 


6 s 


3e-13 


8e-14 


8000 


2 


4 


.06 


10/10 


43.0 


7980.9 


6 s 


2e-13 


8e-14 


8000 


2 


4 


.05 


10/10 


30.1 


7953.1 


5 s 


6e-13 


2e-13 


8000 


2 


4 


.04 


10/10 


19.5 


7891.0 


5 s 


6e-13 


2e-13 


10000 


2 


4 


.07 


10/10 


72.6 


9974.6 


9 s 


3e-13 


7e-14 


10000 


2 


4 


.06 


10/10 


53.8 


9969.1 


8 s 


9e-13 


le-13 


10000 


2 


4 


.05 


10/10 


37.7 


9925.4 


7 s 


5e-13 


2e-13 


10000 


2 


4 


.04 


10/10 


24.3 


9907.2 


7 s 


3e-13 


le-13 


20000 


2 


4 


.030 


10/10 


27.6 


19853.3 


17 s 


7e-13 


2e-13 


40000 


2 


4 


.020 


10/10 


24.7 


39725.2 


50 s 


2e-12 


6e-13 


60000 


2 


4 


.015 


10/10 


21.0 


59461.1 


1 m 52 s 


le-11 


8e-13 


80000 


2 


4 


.013 


10/10 


21.0 


79314.1 


3 m 24 s 


4e-12 


le-12 


100000 


2 


4 


.011 


10/10 


18.8 


99174.4 


5 m 42 s 


2e-10 


9e-ll 



28 



Table 3.2: Results of Algorithm [T] on noiseless problems, using steps RigidCliqueUnion and 
RigidNodeAbsorb. The values for Average Degree, # Sensors Positioned, and CPU Time are 
averaged over ten random instances. The values for Max Error and RMSD values are averaged 
over the successful instances. 











# Successful 


Average 


# Sensors 








# sensors 


r 


# anchors 


R 


Instances 


Degree 


Positioned 


CPU Time 


Max Error 


RMSD 


2000 


2 


4 


.07 


10/10 


14.5 


2000.0 


1 s 


6e-13 


2e-13 


2000 


2 


4 


.06 


10/10 


10.7 


1999.9 


1 s 


8e-13 


3e-13 


2000 


2 


4 


.05 


10/10 


7.5 


1996.7 


1 s 


9e-13 


2e-13 


2000 


2 


4 


.04 


9/10 


4.9 


1273.8 


3 s 


2e-ll 


4e-12 


4000 


2 


4 


.07 


10/10 


29.0 


4000.0 


2 s 


2e-13 


6e-14 


4000 


2 


4 


.06 


10/10 


21.5 


4000.0 


2 s 


6e-13 


2e-13 


4000 


2 


4 


.05 


10/10 


15.1 


3999.9 


2 s 


6e-13 


3e-13 


4000 


2 


4 


.04 


10/10 


9.7 


3998.2 


2 s 


le-12 


5e-13 


6000 


2 


4 


.07 


10/10 


43.5 


6000.0 


4 s 


3e-13 


8e-14 


6000 


2 


4 


.06 


10/10 


32.3 


6000.0 


4 s 


2e-13 


7e-14 


6000 


2 


4 


.05 


10/10 


22.6 


6000.0 


3 s 


3e-13 


le-13 


6000 


2 


4 


.04 


10/10 


14.6 


5999.4 


3 s 


8e-13 


3e-13 


8000 


2 


4 


.07 


10/10 


58.1 


8000.0 


6 s 


3e-13 


7e-14 


8000 


2 


4 


.06 


10/10 


43.0 


8000.0 


5 s 


2e-13 


8e-14 


8000 


2 


4 


.05 


10/10 


30.1 


8000.0 


5 s 


6e-13 


2e-13 


8000 


2 


4 


.04 


10/10 


19.5 


8000.0 


4 s 


7e-13 


2e-13 


10000 


2 


4 


.07 


10/10 


72.6 


10000.0 


9 s 


3e-13 


7e-14 


10000 


2 


4 


.06 


10/10 


53.8 


10000.0 


8 s 


3e-13 


le-13 


10000 


2 


4 


.05 


10/10 


37.7 


10000.0 


7 s 


5e-13 


2e-13 


10000 


2 


4 


.04 


10/10 


24.3 


10000.0 


6 s 


3e-13 


le-13 


20000 


2 


4 


.030 


10/10 


27.6 


20000.0 


17 s 


7e-13 


2e-13 


40000 


2 


4 


.020 


10/10 


24.7 


40000.0 


51 s 


2e-12 


6e-13 


60000 


2 


4 


.015 


10/10 


21.0 


60000.0 


1 m 53 s 


2e-12 


7e-13 


80000 


2 


4 


.013 


10/10 


21.0 


80000.0 


3 m 21 s 


4e-12 


le-12 


100000 


2 


4 


.011 


10/10 


18.8 


100000.0 


5 m 46 s 


2e-10 


9e-ll 



2. In Table 13.21 we report the results of increasing the level of our algorithm to use both the 
RigidCliqueUnion and RigidNodeAbsorb steps (see Figures [2 . 2 1 and [2~4"j) to solve the random 
problems. We see that the number of sensors localized has increased and that there has been 
a small, almost insignificant, increase in the CPU time. 

3. In Table 13.31 we report the results of increasing the level of our algorithm to use steps 
RigidCliqueUnion, RigidNodeAbsorb, and NonRigidCliqueUnion (see Figures \2.2\ 12. 4| and 
12. 3p to solve the random problems, further increasing the class of problems that we can 
complete. 

Testing a version of our algorithm that uses all four steps is still ongoing. From the above results, 
we can see that our facial reduction technique works very well for solving many instances of the 
SNL problem. We are confident that the results of our ongoing tests will continue to show that 
we are able to solve an even larger class of SNL problems. 
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Table 3.3: Results of Algorithm [T] on noiseless problems, using steps RigidCliqueUnion, 
RigidNodeAbsorb, and NonRigidCliqueUnion. The values for Average Degree, # Sensors Po- 
sitioned, and CPU Time are averaged over ten random instances. The values for Max Error and 
RMSD values are averaged over the successful instances. The results of the tests with more than 
6000 sensors remain the same as in Table I5T21 











# Successful 


Average 


# Sensors 








# sensors 


r 


# anchors 


R 


Instances 


Degree 


Positioned 


CPU Time 


Max Error 


RMSD 


2000 


2 


4 


.07 


10/10 


14.5 


2000.0 


1 s 


6e-13 


2e-13 


2000 


2 


4 


.06 


10/10 


10.7 


1999.9 


1 s 


8e-13 


3e-13 


2000 


2 


4 


.05 


10/10 


7.5 


1997.9 


1 s 


9e-13 


2e-13 


2000 


2 


4 


.04 


10/10 


4.9 


1590.8 


5 s 


2e-ll 


7e-12 


4000 


2 


4 


.07 


10/10 


29.0 


4000.0 


2 s 


2e-13 


6e-14 


4000 


2 


4 


.06 


10/10 


21.5 


4000.0 


2 s 


6e-13 


2e-13 


4000 


2 


4 


.05 


10/10 


15.1 


3999.9 


2 s 


6e-13 


3e-13 


4000 


2 


4 


.04 


10/10 


9.7 


3998.2 


3 s 


le-12 


5e-13 


6000 


2 


4 


.07 


10/10 


43.5 


6000.0 


4 s 


3e-13 


8e-14 


6000 


2 


4 


.06 


10/10 


32.3 


6000.0 


4 s 


2e-13 


7e-14 


6000 


2 


4 


.05 


10/10 


22.6 


6000.0 


3 s 


3e-13 


le-13 


6000 


2 


4 


.04 


10/10 


14.6 


5999.4 


3 s 


8e-13 


3e-13 



3.2 Noisy Data and Higher Dimensional Problems 

The above algorithm was derived based on the fact that the SNLhad exact data; i.e., for a given 
clique a we had an exact correspondence between the EDM and the corresponding Gram matrix 
B = K)(D[a\). To extend this to the noisy case, we apply a naive, greedy approach. When the 
Gram matrix B is needed, then we use the best rank r positive semidefinite approximation to B 
using the well-known Eckert- Young result; see e.g., [201 Cor. 2.3.3]. 

Lemma 3.1. Suppose that B € S n with spectral decomposition B = Yli=i \ u i u J > • • • > A n . 
Then the best positive semidefinite approximation with at most rank r is B + = Yli=i(^i)+ U i u f > 
where = max{0,Aj}. □ 

We follow the multiplicative noise model in, e.g., [HI HH [Ml ESI E3 EE] ; i.e., the noisy (squared) 
distances Dij are given by 

D ij = (\\Pi -PjU 1 +0-€ij)) 2 , 

where a > is the noise factor and is chosen from the standard normal distribution A/"(0, 1). 
We include preliminary test results in Table 13.21 for problems with 0%-l% noise with embedding 
dimension r = 2, 3. Note that we do not apply the noise to the distances between the anchors. 

4 Conclusion 

The SDP relaxation of SNL is highly (implicitly) degenerate, since the feasible set of this SDP is 
restricted to a low dimensional face of the S-D-P cone, resulting in the failure of the Slater con- 
straint qualification (strict feasibility). We take advantage of this degeneracy by finding explicit 
representations of intersections of faces of the SDP cone corresponding to unions of intersecting 
cliques. In addition, from these representations we force further degeneracy in order to find the 
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Table 3.4: Results of Algorithm Q] for problems with noise and r = 2,3, using RigidCliqueUnion 
and RigidNodeAbsorb. The values for Average Degree, # Sensors Positioned, CPU Time, Max Er- 
ror and RMSD are averaged over ten random instances. 













Average 


# Sensors 








a 


# sensors 


r 


# anchors 


R 


Degree 


Positioned 


CPU Time 


Max Error 


RMSD 





2000 


2 


4 


.08 


18.8 


2000.0 


1 s 


le-13 


3e-14 


le-6 


2000 


2 


4 


.08 


18.8 


2000.0 


1 s 


2e-04 


4e-05 


le-4 


2000 


2 


4 


.08 


18.8 


2000.0 


1 s 


2e-02 


4e-03 


le-2 


2000 


2 


4 


.08 


18.8 


2000.0 


1 s 


2e+01 


3e+00 





6000 


2 


4 


.06 


32.3 


6000.0 


4 s 


2e-13 


7e-14 


le-6 


6000 


2 


4 


.06 


32.3 


6000.0 


4 s 


8e-04 


3e-04 


le-4 


6000 


2 


4 


.06 


32.3 


6000.0 


4 s 


9e-02 


3e-02 


le-2 


6000 


2 


4 


.06 


32.3 


6000.0 


4 s 


2e+01 


3e+00 





10000 


2 


4 


.04 


24.3 


10000.0 


6 s 


3e-13 


le-13 


le-6 


10000 


2 


4 


.04 


24.3 


10000.0 


6 s 


5e-04 


2e-04 


le-4 


10000 


2 


4 


.04 


24.3 


10000.0 


6 s 


5e-02 


2e-02 


le-2 


10000 


2 


4 


.04 


24.3 


10000.0 
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minimal face that contains the optimal solution. In many cases, we can efficiently compute the 
exact solution to the SDP relaxation without using any SDP solver. 

In some cases it is not possible to reduce the problem down to a single clique. However, 
in these cases, the intersection of the remaining faces returned by SNLSDPclique will produce a 
face containing the feasible region of the original problem. This face can then be used to reduce 
the problem before passing the problem to an SD P solver, where, for example, the trace of the 
semidefinite matrix can be maximized [9] to try to keep the embedding dimension small. As 
an example, if the problem is composed of disjoint cliques, then Corollary 12.61 can be used to 
significantly reduce the problem size. This reduction can transform a large intractable problem 
into a much smaller problem that can be solved efficiently via an SDP solver. 
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